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FIELD OF THE INVENTION 

This patent specification relates to digital rendering systems. In particular, it 
relates to a method and system for efficient digital rendering over a network. 

5 BACKGROUND OF THE INVENTION 

Three-dimensional computer animation continues to intensely impact the visual arts 
world. In the entertainment industry, for example, three-dimensional computer animation 
has provided the sole basis for several motion pictures, and computer-generated visual 
effects are increasingly used to enhance or replace filmed scenery, special effects, and 

1 0 stunts in filmed motion pictures. Additionally, three-dimensional computer animation has 
furthered the sciences and practical arts by allowing, for example, visual analysis of 
product designs prior to physical assembly (e.g., aircraft designs), and lifelike 
visualizations of planned events (e.g., spacecraft landings). 

As described in Kerlow, The Art of 3-D Computer Animation and Imaging, Wiley 

15 & Sons, Inc. (2000), the production stage in the process of three-dimensional computer 
animation includes the steps of modeling, animation, and rendering. These tasks usually 
take place in a computer animation studio in a collaborative effort among many creative, 
technical, production, and/or administrative personnel (hereinafter "users"), although there 
may be only a single user for the simplest endeavors. The computer animation studio may 

20 comprise one physical site or may be distributed across several sites, in which case the 
sites are usually connected by a wide area network. 

Modeling refers to the creation of the virtual characters, objects, and environments 
that will be used in the movie or feature being produced. Computer modeling can occur 
using a wide range of computer based three-dimensional techniques, ranging from virtual 

25 modeling techniques for the direct creation of virtual objects, to the use of three- 
dimensional digitizers to capture the shape of real- world objects and form virtual objects 
therefrom. For each object, the modeling process yields a body of numerical and symbolic 
information (hereinafter "model") that describes its geometry and other characteristics, 
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usually in isolation from other objects. Models of different but related objects (e.g., hat, 
arm, spurs) can be grouped together in defining a model of a larger object (e.g., cowboy) as 
needed. From a computing perspective, an object model comprises a file or array 
comprising numerical and symbolic information sufficient to define the object according to 

5 a high-level modeling language. Examples of high-level modeling languages include 
VRML (Virtual Reality Modeling Language), Lightwave, Softimage, Maya, and 3D Max 
formats. The size of the file or array containing the model will increase, of course, as the 
complexity of the model increases. Once the virtual actors and objects are modeled, they 
can be arranged on a virtual stage and animated. 

1 0 Animation refers to the incremental changing of the positions and orientations of 

models in three-dimensional space, such that samples of the models and their arrangement 
on the virtual stage can yield an illusion of continuous action when viewed in succession. 
Computer animation techniques range from keyframing animation in which starting and 
ending positions are specified for all objects in a sequence, to motion capture in which all 

1 5 positions are fed to the objects directly from live actors whose motions are being digitized. 
The animation process results in a sequence of logically related samples that 
together form a "shot," with a collection of logically related shots forming a "scene" of an 
overall production. As known in the art, the term "scene" additionally refers to the 
selection and configuration of the virtual objects, characters, and environments that are the 

20 subject of the sequence being animated. Thus, for example, a computer-animated feature 
film may contain a scene of a wild West gunfight, the scene comprising virtual models of 
two cowboys, their horses, and a crowd positioned against a virtual town environment, the 
scene further comprising a first shot of a close-up of one cowboy as he warns the other 
cowboy, a second shot of the cowboys pointing their guns at each other, a third shot of the 

25 crowd gasping, and so on. 

From a computing perspective, the result of the animation process is a sequence of 
three-dimensional representations of object models in progressively different positions and 
orientations, each member usually being expressed according the same high-level 
modeling language supra. At this point, the virtual objects are still expressed in three- 
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dimensional form and are not suitable for viewing, except perhaps in "wireframe" 
renditions as the animation is perfected. Once the virtual objects are modeled and 
animated, they can then be rendered. 

Rendering refers to the process of visually representing the animated models with 

5 the aid of a simulated camera, thereby producing the output images that are actually 
viewed by the audience. In many ways, the rendering process is analogous to the 
cinematography process for standard filmed movies. A Hollywood cinematographer must 
optimally capture physical actors and objects on a movie stage with a properly positioned 
camera, carefully selected lighting, and other carefully selected parameters for transferring 

1 0 the scene onto a tangible two-dimensional viewable medium (film). Likewise, the 

computer rendering process must optimally capture virtual actors and virtual objects on a 
virtual three-dimensional stage, capturing them with a properly positioned simulated 
camera, carefully selected virtual lighting, and other carefully selected parameters for 
transferring the virtual scene onto a tangible two-dimensional viewable medium (a digital 

1 5 image file). The output of the computer rendering process is a sequence of two- 
dimensional images that form the final product viewable by an audience. The lighting of 
the scene and the shading characteristics are often specified before the animation is laid 
out, but the rendering itself, the calculation of the finished images, necessarily happens 
after the modeling and animation parameters have been defined. 

20 The production-stage tasks of modeling, animation, and rendering can be 

performed using any of a variety of application software packages ranging from 
proprietary software solutions to commercial off-the-shelf software packages. Because 
there is tremendous latitude in the way production-stage tasks might be achieved, different 
commercial software packages have arisen and/or evolved that perform different 

25 combinations and sub-combinations of the above production-stage tasks. Thus, some 
software packages may be for modeling only or animation only, other packages may 
perform both modeling and animation, still other packages may perform rendering only, 
and still other packages may perform all three functions. 
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Additionally, many adaptors and interfaces exist for allowing, for example the 
rendering engine of a first package to render the modeled and animated data generated by a 
second package, commonly through a "plug-in" that allows the user to remain in the 
environment of the second package while manipulating the rendering data and rendering 
5 controls. By way of example and not by way of limitation, RenderMan™ is a popular 
collection of rendering tools available from Pixar Animation Studios, Inc. of Emeryville, 
California, that includes a rendering program, a scene description interface, and a shading 
language. A user may choose to use Maya®, a popular modeling and animation package 
(also capable of rendering) available from Alias/Wavefront of Toronto, Canada, to model 

1 0 and animate a scene, and then use MTOR, a RenderMan plug-in developed for Maya, to 
connect Maya to the RenderMan engine. Maya primitives are converted into a RIB 
(RenderMan Interface Bytestream) file. The RIB file is then interpreted by the RenderMan 
engine to produce rendered frames. 

It is to be appreciated that while some terminology infra may have some elements 

1 5 in common with the RenderMan package, the Maya package, or other commercial software 
packages, the descriptions of the preferred embodiments are not intended to be limited to 
these restricted environments. Rather, the preferred embodiments described infra may 
applied in many different contexts using any of a variety of modeling, animation, and/or 
rendering programs. The preferred embodiments described herein are generally applicable 

20 to any environment in which rendering data and rendering controls are produced by a 
modeling application, an animation application, or other graphics application, and are then 
provided to a rendering engine that produces rendered frames. 

Most commonly, to carry out the rendering process, the user manipulates their 
modeling application (e.g., Maya, Lightwave, etc.) to generate rendering data and 

25 rendering controls. The user then instantiates a rendering process in which the rendering 
data and rendering controls are submitted to a rendering engine. In a process that is highly 
computationally intensive, the rendering engine then produces rendered frames in the form 
of digital image files in any of a variety of formats (e.g., jpg, gif, tif, etc.). The process is 
highly iterative, with the rendering data and/or rendering controls being modified and 
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tweaked until the desired output is achieved. Generally speaking, each time any portion of 
the rendering data or rendering controls is adjusted, the entire computing process 
performed by the rendering engine must be repeated. 

More specifically, the user manipulates their modeling application in a first step of 
5 getting the models to be rendered from some kind of peripheral storage device like a hard 
disk. These models usually include virtual characters, props, sets, and other objects. In 
another step, a simulated camera is maneuvered in virtual x-y-z space so that the user can 
look at the portion of the environment they are interested in. They might reposition the 

1 camera, tilt it, change the focal point and depth of field, and adjust proportions and 

m 10 resolution parameters. In another step, the lighting scheme is designed, the user placing at 

f! least one light source, and often several light sources, in the three dimensional space of the 

IH computer software. In another step, the user specifies many characteristics of the surfaces 

, * of the objects including color, texture, shininess, reflectivity, and transparency. Selection 

2 of these rendering parameters will have a great impact on the quality, refinement, and 

6 1 5 energy of the rendered frames produced by the rendering engine. Finally, the user selects a 
O shading method (e.g. faceted, smooth, specular, RenderMan, etc.). Further descriptions of 

^ shading methods and other specific rendering controls can be found in Kerlow, supra. For 

purposes of the present disclosure, it is of significance primarily to note that each of the 
many sets of user modifications/tweaks of the rendering data or the rendering controls 
20 results in the need for an additional rendering job to be submitted to the rendering engine. 
After rendering controls and rendering data are specified, the user submits a 
rendering request to instantiate the transfer of the rendering data and the rendering controls 
to the rendering engine. This is usually performed by pressing a "render" control button 
provided by the rendering engine plug-in to the modeling application. The modeling 
25 application then provides the rendering data and rendering controls to the rendering engine. 
As known in the art, when the geometry or shading in any given scene are too 
complex, it is common to render different components of a scene in separate layers. The 
rendered layers are then later composited in a post-production process. For clarity of 
disclosure, the term "rendered frame" is used to identify a rendered output corresponding 
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to one time sample of a shot, scene, or a layer thereof, it being understood that layered 
outputs would be later composited to form the actual output image viewed by the audience. 
The rendered frames are usually displayed to the audience at a rate of 24 frames per second 
(fps) for film and 30 fps for video. A rendering session maps on to a subset of a movie 

5 production flow - be it a scene or a shot, or on to a smaller rendering task. The larger 
extent of the workflow, for which sessions are conducted is termed a project. 

FIG. 1 shows a conceptual hierarchy of rendering data and rendering controls as 
provided from a modeling application/rendering engine plug-in upon instantiation of a 
rendering request. Rendering data 102 generally comprises appearance parameters and 

10 geometry parameters. Appearance parameters comprise shaders, provided in the form of 
shader files, and textures, provided in the form of texture files. As known in the art, 
shaders control the appearance of the site of the scene, specifying, for example, lighting 
and surface behaviors (e.g., matte, plastic, specular, etc.). Also as known in the art, 
textures are used to further specify the appearances of surfaces, and are provided in the 

15 form of 2-D image files, or alternatively as 3-D image volumes that comprising a plurality 
of related 2-D image files. Textures are usually very large data files, exceeding a total 
volume, for example, of 250 Gbytes for an entire project. There is a dependency between 
shaders and textures in that the shaders reference textures in mapping the textures onto 
objects during the rendering process. 

20 Geometry parameters comprise procedural geometry information ("procedurals"), 

provided in the form of procedural geometry files ("procedural files"), as well as 
geometries provided by the scene description files. As known in the art, procedurals are 
used to describe geometric elements in terms of algorithms, rather than in terms of simple 
coordinates, providing a way to model more complicated objects. Scene description files 

25 describe the overall scene in terms of both scene descriptions and object geometries. They 
are first specified by a modeling program, supra, responsive to manipulations by a user. 
Thus, scene description files are considered to contain both geometry information on the 
rendering data side of FIG. 1, as well as scene description information on the rendering 
controls 104 side of FIG. 1. The scene description file is where all the geometry 
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(polygons, surfaces), as well as shaders and procedural, are referenced. As indicated in 
FIG. 1, and as used herein, rendering resources shall refer to the collection of scene 
description files, shader files, texture files, and procedural files used by the rendering 
engine in generating rendered images. 

5 FIG. 2 shows a conceptual diagram of the "generation" process associated with 

rendering resources in most conventional 3-D computer animation systems today. 
Generally speaking, as a result of user manipulations, the modeling application will 
provide raw shader files 202, raw procedural files 204, and raw scene description files 208 
for downstream rendering. Although they are automatically created by the modeler, these 

10 raw or "uncompiled" files are usually in ASCII format or other human-readable format and 
are not directly usable by the rendering engine. Rather, they must first be compiled or 
"generated" in a preprocessing step prior to use by the rendering engine. 

As indicated in FIG. 2, generation of raw shader files 202 (provided in the form of 
.si, .c, .cpp. or .h files as known in the art) is an intrinsic process that depends largely on a 

1 5 set of independent shader make parameters 2 1 0, also provided by the modeling 

application. Upon generation, generated shader files 218 (e.g., .so files) can be provided to 
the rendering engine. Likewise, generation of raw procedural files 204 (provided in the 
form of x, xpp. or .h files as known in the art) is an intrinsic process that depends on 
independent procedural make parameters 214, and generation of raw scene description files 

20 208 (e.g. , provided in the form of .rib files as known in the art) is an intrinsic process that 
depends on independent scene description make parameters 216. Upon generation, 
generated procedural files 220 (e.g., .so files) and generated scene description files 224 
(e.g., .rib files) can be provided to the rendering engine. 

Unlike the other rendering resource files, texture files 206 (e.g., tif, jpg, gif, etc) 

25 may be created separately from the modeling application, e.g., a user may have get them 
from digital camera outputs, artist drawings, and the like. However, texture files 206 may 
also be modified or provided by some modeling applications. Texture files usually also 
require generation, in the form of image processing algorithms such as blurring, edge 
enhancement, etc. Unlike the other rendering resource files, the generation of texture files 
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206 is not implicit, but requires information from the scene description file 208 as well as 
texture make parameters 214. Accordingly, texture generation is a highly scene- 
dependent, and even frame-dependent, task. Upon generation, generated texture files 222 
(e.g. .tif, .jpg, .gif, etc.) may then be provided to the rendering engine. The above 

5 generation tasks may be performed by the rendering engine itself in a preprocessing task, 
or may be performed by auxiliary systems prior to job submission. 

A problem arises in conventional 3-D computer animation studios today as a result 
of the massive computational power needed by the rendering engines. There is a trade-off 
between capital investment in computing resources (in the form of large "rendering 

1 0 farms") versus the speed at which rendering can happen. For studios large enough to have 
their own rendering farm, the rendering farm is usually connected to a team of users over a 
local area network (LAN). Conventionally, rendering jobs are submitted separately by 
individual users, whose rendering jobs sit in a queue until the rendering engine is available 
for that job. An administrator (usually a human) often makes real-time decisions about 

1 5 task prioritization among j obs in the queue. According to an exemplary prior art system, 
generation of rendering resources is not coordinated in a systematic manner, and often the 
rendering engine and other network resources end up performing redundant generation 
and/or rendering tasks. The conventional scenario may be particularly frustrating for a 
user who has only made a minor tweak or addition to their model or another rendering 

20 resource. For example, while the user may have simply moved the position of a light, they 
must again wait in the queue, have their rendering resources generating, and have the 
rendering process repeated. 

Bottlenecks and inefficiencies caused by limited studio computing resources may 
be remedied somewhat by online rendering services that rent computing time to remote 

25 users on a per-session basis. For a price, a remote user may submit their rendering 

resources (raw or generated) to the online service and, for a greater price, may have their 
rendering jobs given high priority in the online queue. One shortcoming of conventional 
online rendering services, however, lies in the massive amount of data that needs to be 
transferred across the internet. While shader files and procedural may generally be "slim" 
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resources not requiring excessive bandwidth, scene description files and textures can be 
massive in size. By way of example, a typical session for rendering frames corresponding 
to ten seconds of an animated feature would require the transfer of about 2 Gbytes of data 
for the scene descriptions (raw or generated) and 2 Gbytes of textures. There can be up to 
5 250 Gbytes of textures corresponding to an overall project. Accordingly, it could be quite 
frustrating for a remote user who has made a minor tweak in their rendering resources to 
require resubmission of these massive amounts of rendering resource data to the online 
rendering engine. 



10 SUMMARY OF THE INVENTION 

A method, system, and protocol for digital rendering over a network is provided, 
wherein a rendering service receives a rendering request from a client, and generates 
rendered frames responsive to the rendering request. In accordance with a preferred 
embodiment, rendering resources associated with a project are stored in a project resource 

15 pool at the rendering service site, and for each rendering request the proj ect resource pool 
is compared to the current rendering resources at the client site. A given rendering 
resource is transmitted from the client site to the rendering service only if a current version 
of that rendering resource is not contained in the project resource pool. Advantageously, 
bandwidth between the client site and the rendering service site is conserved when many 

20 related rendering requests are submitted, such as when a user makes minor tweaks and 
modifications to one or more rendering resources between sessions. 

Preferably, rendering resources are transmitted from the client to the rendering 
service in raw format, for providing platform-independence of the rendering service among 
various client modeling and animation software and hardware packages. Raw rendering 

25 resource files specified in the rendering request are validated in the proj ect resource pool 
by comparing the project resource pool against the current raw rendering resource files at 
the client site. Only invalid raw rendering resource files are uploaded from the client site. 
The raw rendering resource files are preferably chunked on a per-frame or per-tile basis. 
Raw rendering resource files are generated or made into generated rendering resource files 
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and submitted to the rendering engine. In accordance with a preferred embodiment, 
redundant generation of raw rendering resource files is avoided by only generating those 
raw rendering resource files not mated with a generated rendering resource files. 
In accordance with another aspect of the invention, a modeling program is 
5 manipulated such that a resulting scene description is modularized into at least one static 
scene description file and one dynamic scene description file. The static scene description 
file contains geometries and other primitives that generally do not change among 
successive frames of a session, while the dynamic scene description file contains 
geometries and other primitives that do change among successive frames of a session. 
1 0 When a rendering request for the session is submitted in accordance with the above 
protocol, a statistically fewer number of rendering resource files will be uploaded to the 
rendering service because the static scene description files will be constant across many 
frames and therefore not uploaded for those frames. 

1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a conceptual hierarchy of rendering data and rendering controls as 
provided from a modeling application/rendering engine plug-in upon instantiation of a 
rendering request; 

FIG. 2 shows a conceptual diagram of a generation process associated with 
20 rendering resources; 

FIG. 3 shows a diagram of a rendering service and a rendering client site in 
accordance with a preferred embodiment; 

FIG. 4 shows steps corresponding to operation of a rendering service as 
experienced by a user for an interactive mode in accordance with a preferred embodiment; 
25 FIG. 5 shows steps corresponding to operation of a rendering service as 

experienced by a user for a batch mode in accordance with a preferred embodiment; 

FIG. 6 shows a diagram of a rendering session storage hierarchy at the client site in 
accordance with a preferred embodiment; 
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and submitted to the rendering engine. In accordance with a preferred embodiment, 
redundant generation of raw rendering resource files is avoided by only generating those 
raw rendering resource files not mated with a generated rendering resource files. 
In accordance with another aspect of the invention, a modeling program is 

5 manipulated such that a resulting scene description is modularized into at least one static 
scene description file and one dynamic scene description file. The static scene description 
file contains geometries and other primitives that generally do not change among 
successive frames of a session, while the dynamic scene description file contains 
geometries and other primitives that do change among successive frames of a session. 

1 0 When a rendering request for the session is submitted in accordance with the above 
protocol, a statistically fewer number of rendering resource files will be uploaded to the 
rendering service because the static scene description files will be constant across many 
frames and therefore not uploaded for those frames. 



1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a conceptual hierarchy of rendering data and rendering controls as 
provided from a modeling application/rendering engine plug-in upon instantiation of a 
rendering request; 

FIG. 2 shows a conceptual diagram of a generation process associated with 

20 rendering resources; 

FIG. 3 shows a diagram of a rendering service and a rendering client site in 

accordance with a preferred embodiment; 

FIG. 4 shows steps corresponding to operation of a rendering service as 
experienced by a user for an interactive mode in accordance with a preferred embodiment; 
25 FIG. 5 shows steps corresponding to operation of a rendering service as 

experienced by a user for a batch mode in accordance with a preferred embodiment; 

FIG. 6 shows a diagram of a rendering session storage hierarchy at the client site in 
accordance with a preferred embodiment; 
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FIG. 7 shows a diagram of a rendering proj ect storage hierarchy at a rendering 
service site in accordance with a preferred embodiment; 

FIG. 8 shows a diagram of a remote rendering protocol administrative database at 
the rendering service site in accordance with a preferred embodiment; 
5 FIG. 9 shows overall steps taken by a remote rendering protocol server in 

accordance with a preferred embodiment; 

FIG. 10 shows steps corresponding to an authentication step of FIG. 9; 
FIG. 11 shows steps corresponding to a validation step of FIG. 9; 
FIG. 12 shows steps corresponding to a resource upload step of FIG. 9; 
10 FIG. 13 shows steps corresponding to a resource generation validation step of FIG. 

9; 

FIG. 14 shows steps corresponding to job submission, monitoring, and return steps 
of FIG. 9; 

FIG. 15 shows steps taken by a remote rendering protocol plug-in in accordance 
1 5 with a preferred embodiment; 

FIG. 16 shows steps taken by a remote rendering protocol client application m 
accordance with a preferred embodiment; and 

FIG. 17 shows a conceptual diagram of static and dynamic scene description files 
created using a modeling application in accordance with a preferred embodiment. 

20 

DETAILED DESCRIPTION 

The preferred embodiments described herein may be advantageously used in 
conjunction with the system described in Nicolas et. al, "Method and System for Creating 
and Managing a Digital Content Creation Project Over a Network," U.S. Serial No. 
25 09/738,466, filed December 15, 2000, (BEL-020), which is assigned to the assignee of the 
present invention, and which is incorporated by reference herein. A remote rendering 
protocol (rrp) refers to methods and protocol items used to provide an efficient, reduced- 
redundancy rendering service for rendering data produced at a client site, as described 
herein. A goal of the rrp is to establish a fundamental interface for the rendering service. 
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The rrp provides user authentication, session control, render description, status control and 
monitoring, and resultant image transfer dialog items. 

The challenge of a qualitative remote rendering service is on both the imagery 
produced and the ability to sustain a balance between rendering compute time and transfer 

5 of resources and images over the WAN/Internet. In addition, tightly securing user 
resources, uploaded and safely stored on the rendering service site, plays a major role in 
gaining market acceptance of the service. A secure site with provisions to remotely manage 
storage transparently has the potential for the user to forego expensive local resource 
management on their end. 

1 0 While the preferred method, system, and protocol is advantageously employed by a 

remote rendering service distant from the client site and connected thereto over the Internet 
or other Wide Area Network (WAN), it is to be appreciated that the preferred 
embodiments described herein are not limited to this scenario. For example, the preferred 
embodiments may also be applied where the rendering service is co-located with the client 

1 5 site and connected thereto by a LAN. 

FIG. 3 shows a diagram of a rendering service 320 (also termed a host site) and a 
rendering client site 302 (also termed a remote site) in accordance with a preferred 
embodiment, coupled across a WAN 318 such as the Internet. Client site 320 comprises a 
plurality of workstations 304 to interface with a plurality of users on a project, each 

20 workstation 304 comprising modeling application 306 and an rrp (remote rendering 
protocol) plug-in 308. An rrp client application 312 (hereinafter "rrp client"), usually 
running on a dedicated workstation, is connected to the workstations 304 over a LAN 310. 
Also accessible to workstations 304 over LAN 310 is a local project storage archive 314. 
While shown as a separate element in FIG. 3, a local project storage archive 314 may be 

25 distributed across one or more workstations or other nodes. Advantageously, the 

references to file locations are full pathnames in the rrp, so a single project storage archive, 
while recommended, is not required. Indeed, resources maybe distributed across several 
different local area networks if desired. 
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Rendering service site 320 comprises an rrp server application 322 (hereinafter "rrp 
server"), a scene server 330 coupled to a rendering engine 332, a project archive 326, an e- 
commerce server 334, and an rrp administrative database 328 coupled by a LAN 324. 
While preferably on separate server machines, these devices may be generally be 

5 integrated onto a single scalable platform, or may be integrated in any combinations on 
common devices. The software for both the rrp client 312 and the rrp server 322 is, for 
example, Java based to ensure portability across platforms. The devices of FIG. 3 are 
adapted and configured to perform the functionalities described herein, it being understood 
that a person skilled in the art would be readily able to implement the remote rendering 

1 0 system of FIG. 3 in light of the present disclosure. 

FIG. 4 shows steps corresponding to operation of a rendering service as 
experienced by a user for an interactive mode in accordance with a preferred embodiment. 
The rrp may be exploited in either an interactive or in a batch mode. The rrp may 
commence in either a push or a pull manner to address both interactive and batch rendering 

1 5 modes, respectively. The user interacts with a modeling application, and at a given point 
will spawn a rendering request. A rendering response is then awaited, for which 
displayable, resultant images are downloaded to the remote site. Alternatively, a stack of 
scene descriptions could be prepared up front and be submitted for remote rendering at a 
later stage or perhaps in a prescribed time window. 

20 The round trip of a rendering request and a rendering response pair is termed a 

session. In interactive mode a single session is invoked at a time and iteratively rendering 
parameters are tweaked and modified to address acceptable quality level of imagery. In a 
larger production scope, a session maps on to a scene, a shot or a layer (in a movie 
context), often times bearing little dependency on each other. A rendering session group is 

25 then formed and concurrent sessions are conducted, utilizing the high rendering power of 
the rendering engine 332. 

The rendering service (also termed remote rendering service herein) is part of a 
larger workflow scope and is intended to seamlessly integrate in an already existing 
behavioral model on the user end. A remote rendering session maps on to a subset of a 
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movie production flow - be it a scene or a shot, or on to a smaller rendering task. The 
larger extent of the workflow, for which sessions are conducted, is termed a project. The 
user submits rendering sessions at their own pace. The user allocates anticipated frames per 
session and assigns scene description, shader, texture and procedural resources from its 

5 own structured storage pool. The rrp simply requires a path or a universal resource locator 
(URL) to these resources in order to perform remote rendering. Resultant rendering 
images, once downloaded to the remote site, are extracted from the rrp client space and are 
integrated into the next remote production step - image compositing. 

The invocation of remote rendering from a given animation application e.g. Maya, 

10 PRMan, 3D StudioMax, is via a "render" dialog box. In this dialog box the user 

authenticates to the rendering service site and sets workflow related rendering parameters 
before submitting a session. Workflow parameters include interactive (default) versus 
batch mode, and full versus preview display resolution. 

In interactive mode the user runs the animation application and at some point hits 

15 the "render" dialog box (step 402). Consider the single frame, rendered to display case, 
first. The user then chooses one of full or preview resolution options and submits his 
rendering request. The rrp plug-in 308, associated with the modeling application 306, 
opens a window on the user's screen where the above workflow related rendering 
parameters are entered (step 404). Transparent to the user, the rrp client commences a 

20 rendering session. As soon as the first rendered image tile is available on the rendering 
service site, the rrp server 322 sends it back to the rrp client 312. The rrp client 312 streams 
it on to the rrp plug-in 308, which refreshes the opened window on the user screen (step 
406). 

Multiple frames are handled similarly in a progressive manner. Frame images 
25 destined to a file are treated similarly, avoiding opening a rendered display window. The 
rrp client 312 passes to the rrp plug-in 308 a rendering summary log for future user 
reference. Billing and session completion email notification (step 408) are further sent out 
to the user from the e-commerce server 334. The interactive scenario presented makes the 
rendering process substantially transparent regardless of running it locally or remotely. 
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FIG. 5 shows steps corresponding to operation of a rendering service as 
experienced by a user for a batch mode in accordance with a preferred embodiment. Batch 
mode rendering involves a project administrator (not shown) on the remote site. Initially, 
users run the modeling application 306, each covering a unique portion of the overall 

5 project. At a given point they will submit a remote rendering request (step 502) similar to 
the manner they operate in interactive mode. However, in the dialog box, the batch 
rendering mode box will be checked (step 504). The rrp plug-in 308 deposits session(s) 
control information in identical manner as in the interactive case. However, there will be 
no action by rrp client 3 12 for submitting the request remotely to the rendering service site. 

1 0 Once the stack of rendering sessions has been prepared the project administrator 

will setup the batch for rendering using the rrp client batch tool (step 506). In this process 
the administrator assigns a priority to each session and then submits the batch for 
rendering. Throughout the batch rendering the rrp client displays the current state of 
rendering for each session (step 508). Rendered images are returned by the rrp server to the 

15 rrp client and are stored at a prescribed location and an e-mail notification of completion is 
sent (step 510). Note that in batch mode rendered images are always stored into a file. 
Overall rendering efficiency for batch mode is a concern and overlap of transfer and 
rendering is significant. Again, batch mode is fairly transparent to the user who drives the 
application. As per the project administrator, the process is similar to a localized batch 

20 rendering process. 

In accordance with a preferred embodiment, the remote rendering protocol upon 
which a request/response oriented communication is based between the rrp client 312 and 
the rrp server 322 includes the following items: (i) live, (ii) authenticate, (iii) render, (iv) 
display, and (iv) status. The sequence of the first four protocol elements establishes the 

25 end-to-end rendering session supra (or a session group under the same authentication act, 
for batch mode). Every session is unique and is associated with a session ID. The ID 
facilitates data caching on the rendering service site in the case of session resubmit, 
discussed further infra. 
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The live protocol instance establishes a connection to the service, checking that the 
rendering service is up and running. The authenticate item validates the proper registration 
of a user to the service. A successful authentication creates an initial session ID (and 
optionally a range of session IDs, once in batch mode) for the successive protocol items. 
5 This item is conducted in a secure manner to ensure customer privacy. 

According to a preferred embodiment, authentication parameters are keyed in a 
localized authentication control xml file "authen.xml" (see Appendix A, infra). The 
authentication protocol accepts an option for which a fully secured session is conducted 
throughout its entirety, once desired by the user. Again, this is to ensure a higher level of 

10 rendering privacy. Batch rendering is optionally set in the authentication protocol to 

override the default interactive mode. A failed live or authenticate protocol item results in 
service suspension until outstanding issues have been resolved. 

The render item is used to provide the rendering service the identification of the 
rendering resources required to commence rendering. The resources include scene 

15 description files, shaders, textures, and procedural. Identification of the rendering 
resource files is encapsulated in a session control xml file "session.xml," depicting the 
proper rendering resource bindings throughout the process. In addition, session metadata 
is embedded in the session control file for the purpose of registering job assignment and 
generic database parameter inserts into the rrp administration database 328. The metadata 

20 recorded is aimed to facilitate future tracking and mining. A sample session control file is 
illustrated in Appendix B. 

As described supra with respect to FIG. 2, raw rendering resources are required to 
be generated before being sent to the rendering engine. Resource generation is not implied 
in the rrp protocol itself. However, the rrp protocol provides an infrastructure for 

25 customization based on user preferences, format conversion, and grouping of resources. 
While resource generation is not implied in the rrp protocol itself, according to a preferred 
embodiment, resource generation is performed at the rendering service site in a manner 
that saves overall system bandwidth and processing effort. Rendering resource generation 
is performed according to settings specified in resource generation control files, in 
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particular, a scene description resource generation control file "scene_gen_control.xml ," a 
shader resource generation control file "shader_gen_controLxmP' (see Appendix D, infra), 
a texture resource generation control file "texture_gen_control.xml" (see Appendix E), 
and a procedural resource generation control file "procedural__gen_control.xmr (see 
5 Appendix F). 

The generation control xml files are usually optional for scene descriptors, shaders 
and procedural mostly since these resources abide by default generation criteria. 
However, the texture control file is mandatory at the rrp protocol level once texture 
resources are present. If the generation control xml files are not provided for the scene 

10 descriptors, shaders, textures, or procedural, then the protocol implies their default 
generation using sensible parameters. 

Rendering resource files, in particular scene description and texture files, are likely 
to be fairly large, in the order of tens of megabytes. In accordance with a preferred 
embodiment, to avoid costly network retries due to a faulty network, rendering resources 

15 files are chunked to smaller, favorable quanta prior to their transfer. Preferably, the logical 
chunking scheme for scene description files is frame boundaries. Similarly, tiling is a 
preferred method for textures, which enhances specificity of access by the rendering 
service. 

The display protocol item is created by the rendering service and transferred from 
20 the rrp server 322 to the rrp client 312, indicating a successful (or unsuccessful) session 
result. This is normally followed by a downloading of final rendered images, on a per 
frame basis. The default image file format is .tif in order to support a wide variety of image 
types and formats (e.g. a floating point, four color channel image entity). The response 
message entails a display control xml file (see, e.g., Appendix C, infra). The file contains 
25 useful customer info to be kept as a history log for future reference e.g. overall rendering 
time for the session, image type, format and resolution, on a per-frame basis. 

The status protocol item is interspersed in the rrp protocol in tandem with the 
render item. The purpose of the status protocol item is to periodically query the rendering 
status of the outstanding rendered frames in the session. The per-frame status information 
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provided by the server to the client primarily includes analog progress and rendered status, 
e.g., success or failure. This data is readily available for graphical display. The rrp is 
extensible and items can be added to augment functionality, as necessary. An example of a 
status.xml file is provided in Appendix G, infra. 

5 The rrp client 312 provides a thin layer interface between the animation or 

modeling application 306 (via the rrp plug-in 308) and the rendering service site. The rrp 
plug-in 308 generates object and frame scene description files and potentially shader files, 
every time the user interacts with the render application dialog box. The rrp client 312 is 
substantially transparent to the user, and is invoked by the rrp plug-in 308 indirectly for 

10 submitting a rendering session. In both interactive and batch modes, the rrp plug-in 308 
pushes authentication and session control files into a prescribed sessions structure in local 
project storage 314, as described infra with respect to FIG. 6. The rrp client 312 in turn 
parses the control files and copies (or uploads) rendering resource files over the internet 
from local project storage 314 onto the rendering service site, according to results of a 

15 validation process performed at the rendering service site. Scene description files are 
divided into global, geometry and appearance types. Global scene description files capture 
global rendering state parameters (e.g. display resolution, sampling rates, level-of-detail), 
which apply to all subsequent frames. Geometry comprises either static or dynamic 
primitives. Static geometry is retained throughout the extent of the animation frames. 

20 Deformed geometry is dynamically changing across frames (and not necessarily all 

frames). Both dynamic geometry and appearance files are chunked on a per frame basis. 

The rrp client 312 communicates with several users of workstations 304 
concurrently. In interactive mode the rrp client 312 receives from each application user 
(via the rrp plug-in 308) the network identification of its host so that returned display 

25 images will get properly routed to the expected destination. Batch mode implies an 

additional process step on the client side. The project administrator consults an rrp client 
batch tool to register sessions and assign promptness and billing criteria. Only then, the 
stack of sessions are submitted for rendering. The rrp client 312 provides an essential 
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rendering progress report of each of the session batch members once a batch has been 
submitted. 

The rrp client provides the project administrator means to abort a session in the 
middle, for any reason in either interactive or batch modes. The client sends an abort 
5 message to the server to remove it from the rendering queue. 

FIG. 6 shows a diagram of a logical local session hierarchy located, for example, at 
the local project storage device 314 at the client site in accordance with a preferred 
embodiment. A prescribed session folder hierarchy structure is preferred on the client site. 
At the top of the hierarchy is the sessions folder 600. The sessions folder 600 is a sharable 

1 0 folder exposed to the rrp client 3 1 2 for both the fetch and the store of rrp data. Located 
one level down are the per-session folders 602 and administrator folder 604. Preferably, a 
session folder name is composed of a constant prefix "session" followed by a unique 
identifier, which describes the session production scope. However, any of a variety of file 
naming conventions may be used in accordance with the preferred embodiments. The 

1 5 identifier is a user choice and is intended to fit the remote workflow conventions. Session 
group identifiers are expected to be consistent across sessions and to maintain equal string 
length for ease of tracking. A potential identifier name hierarchy is of the form <movie 
namexscene index><shot indexxlayer index>. Examples for session folder names may 
include "session_ToyStory3Scene07Shot023Layerl" and "session_MyLatestModel " A 

20 folder name conflict-free paradigm for session folders is of importance, and this 

responsibility lies under the remote site supervision. Importantly, user-specific storage 
techniques at their respective workstations need not be altered to conform to the preferred 
embodiments, because the session.xml file or other control file will provide pointers to 
physical data locations as necessary. 

25 A session folder 602 is composed of an authentication control file "authen.xml", a 

session control file "session.xml" resource generation control files 612, and a display 
folder 606. The display session folder 606 is the target of final rendered images, in both 
interactive and batch rendering mode. The display folder stores the display control file 610 
"display.xml" and the resultant frame image files 608. Frame file names may, for 
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example, resemble the convention of a fixed prefix "frame", followed by the identifier of 
the session folder, and a frame index. The frame index is a zero-based count of four 
decimal digits (leading zeros for indices under 1000). The index implies 10000 frames per 
session as an upper bound. A frame display generic context provides per pixel data 
5 containing any combination of color, alpha and depth. Pixel data is split between two files 
- once for color and alpha and the other for depth. 

The administrator folder 604 is intended for authenticating administrative tasks, 
amongst them batch submission. This folder contains an authentication xml file 
"authen.xml" and a batch control file "batch.xml." 
10 The rrp plug-in 308 creates session folders under the exposed session's top-level 

J1 folder. It then pushes the session authentication control files, the session control files, and 

the resource generation control files to the folder. An active session folder is one that 
embeds a session control file but not yet a display response folder, filled in by the rrp client 
312. The rrp client 312 scans session folders and only submits active ones for remote 
15 rendering. 

In interactive rendering mode the display folder 606 is created by the client but is 
not filled in with frame files. The display control file is written to the display folder for 
tracking purposes. Rather, images for display are streamed progressively directly to the rrp 
plug-in 308, and from there onto the rendering window of the modeling application 306. 
20 Upon a cleanly terminated session the rrp client 312 sends a summary log to the rrp plug-in 
308, which responds with a status window in the modeling application 306. hi batch mode 
frame images are always written as files, destined to the display session folder 608. The 
user can either retain or delete fulfilled session folders at their own pace. 

The rrp client 3 12 provides a thumbnail and a video resolution image viewer - the 
25 latter is for display preview of final production, high-resolution images. The viewer 
presents the rendering results in either a stationary or an animated form. 

FIG. 7 shows a diagram of a rendering proj ect storage hierarchy at the proj ect 
archive 326 of the rendering service site 320 in accordance with a preferred embodiment. 
The rrp server 322 is associated with the project archive 326. Session uploaded data, 
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including scene description, shader, texture and procedural files, are all destined to the 
project archive 326. The project archive 326 comprises a front-end project resource pool 
and back-end session storage nodes. The project resource pool mirrors the remote site 
project storage device 314 and serves as a cache of resources to be shared by all session 

5 storage nodes. In addition, the archive being a mirror preserves the original path to binded 
resources for both absolute and relative notation in any of the scene or shader files. 

Project archive 326 comprises data grouped by user ID 700. Under each user ID is 
a set of project directories 702, each for a different project. For each project 702, there is a 
session data folder 704 for storing the session data. Every project is assigned its own scene 

10 description folder 706, shader folder 708, texture folder 710, and procedural folder 712. 
The scene description directory 706 stores modeling and rendering description files with 
all the necessary resource binding information, held in both raw and generated forms. The 
shader folder 708 holds all session shader files in both the raw and generated forms. Both 
natural and procedural textures are kept in the texture folder 710, in both the raw and the 

15 generated forms . Similarly, procedural geometry folder 712 holds procedural geometry 
files in both their source and dynamically loadable (generated) version. 

Raw resource files uploaded from the client site are destined in to the raw sub- 
folder, first. Essentially, a raw resource relates to its source. Raw resources are subject to a 
conversion process, which will fit them to the expected rendering system interface. This 

20 process involves one of scene description conversion or incremental merge, shader 
compilation, texture generation for any of 2D, 3D, environment and bump, and finally 
procedural geometry dynamic library creation. Scene descriptions, shaders and 
procedurals assume an implicit generation process in most cases. The making of textures 
nevertheless, is particular and unique to a session and involves creation parameter 

25 variations. The rrp provides a generic mechanism to accommodate a customized generation 
process by means of resource generation description files. The rrp server 322 parses these 
files and applies making parameters to a single or a group of resources, of the same type. 
Resource description files are much like a "make" file for creating objects from raw 
sources. 
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Examples of resource generation control file formats are depicted in Appendices D- 
F. The presence of a scene description generation control file indicates a need to generate 
a scene resource to the expected renderer format. Shader and procedural resource 
generation control files group any number of rendering resources, each governed by a 
5 make file resource. Objects generated off the source are expected to be linked to libraries, 
which already reside on the rendering service site. The absence of a "make" file in a 
resource generation control file implies default generation. The texture generation file 
**i parameters include input group of image files, output texture file, component conversion, 

"2 type, sub type, mode and filter for each dimension. The generated rendering resources 

fU 10 reside in the "generated" sub-fblders of FIG. 7. Resources under the same directory share 
it the same name space, therefore file name conflict must be avoided. 

~f \ Session data folder 704 comprises one or more individual session storage nodes 

* 714. Each storage node 714 is directly related to the session ED allocated. The session ID 

J5 uniquely identifies each session storage node 714. The physical mapping of the session ID 

U 15 on to a file system location is embedded in the session attribute set, which is registered into 
p the rip administrative database 328 at upload time (discussed further with respect to FIG. 

8). Each session storage node 714 is unfolded to a six-way construct of status, scene, 
shader, texture, and procedural subfolders, as well as display subfolder 716. The scene 
server 330 reports rendering progress, rendering timing and exceptions into a status log file 
20 shown in FIG. 7. The scene, shader, texture and procedural folders contain soft links to the 
project resource pool. Finally, the scene server 330 deposits a session's rendered images 
into the display location 718. The display folder 716 thus comprises a display .xml file 720 
and the rendered frame data 718. 

FIG, 8 shows a diagram of the remote rendering protocol administrative database 
25 328 at the rendering service site 320 in accordance with a preferred embodiment. The rrp 
administrative database stores a plurality of records organized by session ID 802. For each 
session ID, there is a session state parameter 804 and a session attribute set 806. Session 
attribute set 806 comprises data describing the session and its results, which is amenable 
for later searching. By way of example, session attribute set 806 includes the number of 
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frames 808, client-side resource paths 810, project resource pool resource paths 812, and 
resource validation data 814. 

FIG. 9 shows overall steps taken by the remote rendering protocol server 322 in 
accordance with a preferred embodiment. FIGS. 10-14 describe the individual steps in 
5 greater detail. Most generally, at step 902, a client authentication request is received and 
processed. At step 904, rendering resources in the project resource pool are validated, i.e. 
checked against the current versions of the rendering resources on the client side local 
project storage device 3 14 to determine if they are still current. At step 906, invalid raw 
rendering resource files are uploaded from the client site. At step 908, the session is 

10 queued and prioritized. At step 910, which may occur at different times in the process, it is 
determined which resources require generation/compilation, and the generation can occur 
at the rrp server 322, at the scene server 330, at the rendering engine 332 (in a background 
process), or at another node sometime before session job dispatch (step 322). At step 914, 
results are returned to the rrp client 312. 

15 FIG. 10 shows steps corresponding to the authentication step 902 taken by the 

remote rendering protocol server 322. At step 1002, the rrp server 322 site receives a 
client authentication request in the form of an authen.xml file. If the user selects batch 
mode at step 1006, the batch control file batch.xml is received, which includes the number 
of sessions in the batch. A sample of a batch control file is provided in Appendix H, infra. 

20 For each session in the batch (steps 1010, 1012, 1026, and 1028), the session control file is 
received (step 1014) and it is determined, by comparison with the rrp administrative 
database 328, whether a valid session ID already exists. If not, then it is a new session and 
a new session ID is assigned by the rrp administrative database 328 (step 1018). At step 
1020, the session state 804 is changed to "created," and at step 1022 space is allocated in 

25 the project resource pool for the session data. However, if there is already a valid session 
ID in the session control file, then it is a resubmitted job, no new session ID is created, and 
space in the project resource pool is simply reused. At step 1024, the session state 804 is 
set to "resubmitted." 
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A session life span is marked with unique state instances, stored in the rrp 
administrative database 328 at session state location 804. The generation of a session ID 
registers a session as "created." It then proceeds through an "uploaded" state to indicate 
ready for rendering. Submitting a rendering job marks the session as "submitted," once 
5 acknowledged by the scene server. When final rendered images have been stored in the 
project archive node the session is marked as "rendered." Rendered images reaching the 
client indicate a "notified" session. A "resubmitted" session conducts itself through a 
resubmitted, rendered and notified states. Finally, a session, which has been eventually 
removed from the archive, is marked "expired." 
1 0 With regard to step 1 024, a session control file providing a valid session ID 

indicates a session already submitted in the past, most likely with only minor 
modifications. It is assumed that a session resubmitted is currently in either notified or 
expired state. The rrp server 322 searches for the designated project resource pool archive 
session node and will mark the non-expired session state as resubmitted. A session node is 
15 expected to persist in the project archive for a finite duration of time. Once expired the 
session will have to be reassigned a session ID and evolve its life span from creation. A 
session resubmit, implies the equivalent resource validation of a newly submitted session, 
but statistically with less thrashing. Session node storage is reclaimed in the case of 
resubmitting. The status and display sub-folders of the session storage node are cleaned up 
20 prior to job submission. 

FIG. 11 shows steps corresponding to the validation step 904 taken by the remote 
rendering protocol server 322. At step 1 102, raw resource file names and paths are 
extracted from the session control file, and timestamp information is also provided in 
conjunction with the session control file, and thereby the current contents of the client side 
25 local project storage device 314 are received. For each raw resource file (steps 1 104 and 
1 1 14) the file name and timestamp in the project resource pool are compared to these raw 
resource file names and timestamps from the session control file. If there is a match, then 
the raw resource file is valid (step 1 1 12), and if not the raw resource file is invalid (step 
1 1 10). Importantly, although FIG. 1 1 shows a timestamping procedure, it is to be 
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appreciated that many different validation methods, including for example a content 
comparison of the project resource pool files against the client side files, are within the 
scope of the preferred embodiments. 

FIG. 12 shows steps corresponding to the resource upload step 906 taken by the 

5 remote rendering protocol server 322. For each raw resource file identified in the session 
control file (steps 1202, 1212), if the raw resource file is valid then at step 1206 the raw 
resource file is not uploaded from the rrp client 312, as the cached version is still valid. 
However, if invalid, then at step 1208, the file is uploaded from the rrp client 312, 
preferably in frame-delimited chunks where applicable, and placed in the project storage 

1 0 pool. Resource chunking, for the sake of network transfer efficiency, benefits caching as 
well. Frame granularity scene description files are essentially considered as a cache line. A 
cache line is validated once the copy of the frame on the rrp server side is out-dated. In 
addition, scene description files kept to a frame size in scope, provide a streamlined 
pipeline for rendering to commence as scene files are uploaded. Tiled tiff textures benefit 

1 5 the storage on the rendering side by reducing the memory footprint - only accessed tiles 
are downloaded to the rendering system. Also, texture access for filtering is significantly 
improved in a localized texture tile. 

Throughout session upload time, metadata are inserted into the rrp administration 
database 328 to form session attribute set 806. The attribute set mostly includes tag 

20 information extracted of the session control xml file. Session attribute set data may be 
used for later monitoring, billing and mining tasks. Optionally, at step 1210 any generated 
resource files associated with the invalid raw resource file are removed from the project 
resource pool. At step 1214, the session sate is changed to "uploaded", and at step 1216 
the session ID is placed in a "pending" queue of the rrp server 322. 

25 A session job is passed along with the file system path of a project resource pool 

archive node 702. Essentially, the rrp server 322 deposits a single top-level scene 
description file into the session scene sub-folder. The top-level scene file includes all the 
dynamic scene file references of the session and prescribes a project resource pool search 
path for each of the scene, shader, texture and procedural resources. The scene server 330 
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acknowledges the receipt of a session job and commences rendering starting with the 
retrieval of scene description and resources off the designated archive node area. The rrp 
server 322 maintains a pair of job queues for both "pending" and "submitted" jobs to allow 
for flow control measures. The queue's priority is based on billing attributes associated 

5 with the session, mostly indicating the execution promptness of the session (step 908). In 
order to strike a reasonable balance across pending jobs, session might be broken to a 
subset of frames, e.g. the scene server 330 might be informed to conduct rendering in 
between frame index delimiters. Further disclosure related to the rendering request 
interface between the rrp server 322 and the scene server 330 are detailed in Appendix G 

10 infra. 

FIG. 13 shows steps corresponding to a resource generation validation step 910 
taken by the remote rendering protocol server 322. In accordance with a preferred 
embodiment, the rrp server 322 engages in comprehensive checking and cross-checking as 
described herein to reduce redundant resource generation. It is to be appreciated that while 

1 5 some computing expense is incurred by these steps, it is often negligible when compared to 
the substantial computing time dedicated to even a single unnecessary resource generation 
operation. In a simplest scenario (not shown in FIG. 13) according to a preferred 
embodiment, it is assumed that a single raw resource file is associated with a single 
generated resource file, in which case it is easy to detect which raw files need generation - 

20 it would simply be those raw resource files that were invalid during the resource validation 
step 904. However, in FIG. 13 a more complicated superset of this scenario is assumed, 
wherein pluralities of raw rendering resource files may correspond to pluralities of 
generated rendering resource files in the project resource storage pool, as dictated by the 
resource generation control files 612 transmitted with the rendering request. 

25 Thus, at step 1 302, the resource generation control files 6 1 2 are received, 

containing a mapping (from which both forward and reverse mappings can be derived) 
between raw resource files and generated resource files, hi accordance with a preferred 
embodiment, redundant generation of raw resource files is avoided by performing the 
following steps. For each raw resource file "k" specified in the session control file (steps 
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1304, 1324), a forward-mapping of the raw rendering resource file "k" onto a set V of 
dependent generated rendering resource files is made using the resource generation control 
files (step 1306). For each member of the set V (steps 1308, 1322), it is first determined 
whether that member exists in the project resource pool (step 1310). If not, then at step 

5 1320 that member is identified as requiring generation. If that member is in the project 
resource pool, then at step 1312 it is reverse-mapped (step 1312) onto a set W of raw 
rendering resource files, again using the resource generation control files. At step 1316, it 
is determined whether every file in the set W was valid during the resource validation step 
904 supra. If not, then at step 1320 that member is identified as requiring generation. If 

1 0 so, then that member is identified as not needing generation at step 1318. The actual 
process of generating those files being so identified as needing generation may actually be 
performed in any of a variety of ways, e.g., by the rrp server 322 itself, by another node, by 
the scene server 330 and/or rendering engine 332 in a background polling process, and so 
on. Texture resource making is an expensive process. Alternatively, one possible form of 

1 5 texture making caching is to record the latest texture make parameters in the rrp 

administration database 328. A new texture make request is avoided unless generation 
parameters have been changed since last recorded or input image files required validation 
recently. 

FIG. 14 shows steps corresponding to job submission step 912, monitoring, and 
20 results return step 914 taken by the remote rendering protocol server 322. The session will 
most often simply be idling in the "pending" queue of the rrp server application 322, 
unless an "abort" request is received from the rrp client 312 (steps 1402-1404). If such an 
abort request is received, then at step 1406 the session is removed from the pending queue 
and its session state 804 is changed to "notified." Upon reaching the front of the pending 
25 queue, the session job is submitted to the scene server 330 (step 1410) and an 

acknowledgment is received. The session state 804 is changed to "submitted" at step 
1412, and at step 1416 the session is moved from the pending queue to the "submitted" 
queue. If an interactive mode session, the display control file, completed preview tiles, 
and/or completed frames are sent to the rrp client 312 as the rendered frames are received 
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from the scene server 1418. The rrp server 322 will either download final rendered images 
or a scaled down version, once a session requested the display preview option. In display 
preview, high-resolution images are converted into a canonical video format prior to the 
download. In the preview mode all channel data will be converted down to 8 bits. The 

5 client follows with a high-resolution display request or simply dismisses rendering results 
all together. A frame depth file - once present - is scaled down to the proper preview 
resolution, however, depth values are retained to their full dynamic range. 

If an abort request is received at step 1420, the abort command is sent to the scene 
server and an acknowledgement received (step 1422), the session state 804 is changed to 

10 "notified" (step 1424), and the session job is removed from the submitted queue (step 
1426). The process continues until a session completion event is received from the scene 
server (step 1 428), at which point the session state 804 is changed to "rendered" (step 
1430), the session job is removed from the submitted queue (step 1432), the display 
control file and rendered frames are sent to the rrp client 312 if batch mode (step 1434), an 

15 e-mail completion notification is sent (step 1436), the session state is changed to "notified" 
(step 1438), and the e-commerce server 334 is notified to commence final billing (step 
1440). 

FIG. 15 shows steps performed by remote rendering protocol plug-in 308 in 
accordance with a preferred embodiment. At step 1502, user manipulations in the native 

20 modeler are received, and updates to corresponding native scene^description files (e.g. , 
.mel files) are made. At step 1504, a render command is received from the user. At step 
1506, the e-mail address, password, security options, mode, and full or preview display 
parameters are received from the user and provided to the remote rendering protocol client 
application 312. At step 1508, space is allocated on logical local project storage device 

25 3 14 and session directories are created thereon. At step 1510, native modeler scene 

description files are converted to rendering engine compatible scene description files (e.g., 
.rib files). At step 1512, raw shader and procedural geometry files are created and placed 
on the local project storage device 314. Following this step, the remote rendering protocol 
client application 312 performs steps described infra with respect to FIG. 16. At step 
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1514, preview frames and/or completed frames are received if in the interactive mode, or 
else the user awaits for e-mail notification in the batch mode. At step 1516, the preview 
frames and/or completed frames are displayed in the native modeler window. 

FIG. 16 shows steps performed by remote rendering protocol client application 312 
5 in accordance with a preferred embodiment. At step 1602, session workflow parameters 
are received from the remote rendering protocol plug-in 308 from which the authentication 
control file is created. At step 1604, the authentication control file is transmitted to remote 
O rendering protocol server 322 over the Internet or other wide area network. If at step 1606 

5 the job is a resubmission, then the session ID is already known. If the job is not a 

J 10 resubmission, a session ID is received from the remote rendering protocol server 322 at 
M 5 step 1608, At step 1610, a session control file and resource generation control files are 

%j created and transmitted to the remote rendering protocol server 322. At step 1612, invalid 

L file identifiers are received from the remote rendering protocol server 322, and at step 

08 1614, these files are uploaded from the client site to the remote rendering protocol server 

15 322, preferably being chunked on a per frame and/or per tile basis. At step 1 6 1 6, the 
Q remote rendering protocol server 322 is periodically queried (interactive mode). At step 

1618, a display control file and rendered frames are received from the remote rendering 
protocol server 322, in the appropriate session display directory on the local project storage 
device 314 is populated with the data. At step 1620, the remote rendering protocol plug-in 
20 1620 is actuated within the native modeler based on the received data. 

FIG. 17 shows a conceptual diagram of static and dynamic scene description files 
created using a modeling application in accordance with a preferred embodiment. In 
accordance with another preferred embodiment, a method for interfacing with a modeling 
program such as Maya, Lightwave, or the like is provided, comprising the steps of 
25 manipulating the modeling program such that the scene description is modularized into at 
least one static scene description file and one dynamic scene description file. Shown in 
FIG. 17 is a client computer 304, together with first and second static scene description 
files 1704, and with first and second groupings of dynamic scene description files 1706, in 
their native formats (e.g., .mel to correspond to Maya). Also shown in FIG. 17 is the first 
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and second static scene description files 1708, and first and second groupings of dynamic 
scene description files 1710, in formats compatible with the rendering engine of the 
rendering service {e.g., .rib to correspond to RenderMan). The conversion from native 
formats to rendering service engine formats is performed by the rrp plug-in 304. 
5 In accordance with a preferred embodiment, the static scene description files 1 704 

contain geometries and other primitives that generally do not change among successive 
frames of a session, while the dynamic scene description files 1706 contain geometries and 
j-i other primitives that do change among successive frames of a session. When a rendering 

^2 request for the session is submitted in accordance with the above protocol, a statistically 

!1j 1 0 fewer number of rendering resource files will be uploaded to the rendering service because 
U the static scene description files will be constant across many frames and therefore not 

f] uploaded for those frames. Methods for generation of static and dynamic scene description 

files can be found, for example in "Learning Maya," Alias |Wavefront Education 
S Publishing (2000), for the Maya modeler, and "LightWave - Shape: Model, Surface & 

2 15 Light NewTek, Inc. (2000) for the Lightwave modeler. 

Q By way of non-limiting example, it has been found that the above modularization 

r r of scene descriptors can lower the volume of scene descriptions per session from about 2 

GBytes if non-modularized, to about 50 MBytes modularized. Thus, a coarse delta- 
modulation effect takes place, such that only frame-over-frame changes are communicated 
20 to the rendering service, resulting in a savings of both bandwidth between the client site 
and rendering service site, as well as a savings of generation resources at the rendering 
service site. Session scene description files on the remote site are preferably modularized 
on a per-object basis. A modified object by the application impacts only a small subset of 
the session scene description files and hence requires far less resource validation. In many 
25 cases only global rendering parameters are modified across iterative sessions. In this case 
the global scene file is the only item to be validated leaving the rest of the resource in tact 
and readily available for rendering on the rendering service side. 

Secure Internet communications is also provided by the rendering service. 
Rendering resources are very dear to users in animation studios, where innovation and 
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creativity play significant role. The rrp implements Secure Sockets Layer (SSL) and 
Transport Layer Security (TLS) protocols and includes functionality for data encryption, 
server authentication, message integrity, and optional client authentication. Passage of 
rendering control and resource data are passed securely between the client and the server 
5 using an HTTP protocol over TCP/IP. The cryptographic suites listed in Table 1 below are 
supported: 

Table 1: Cryptographic Suites Supported 

Domestic and Global 



Cryptographic Suite 


| Key Length 


RSA public key (authentication and key 
agreement) 


([agreement) . 


RC4 (bulk encryption) 




DES (bulk encryption) 


1164 bits (56efffective) 


Triple DES (bulk encryption) 


|jl92 bits (Ineffective) . 


Diffie-Hellman public key (key 
agreement) 


^|l024Hts 


PSA public key (authentication) 





1 0 With regard to data compression, network bandwidth appears to be a scarce 

resource and trading off traffic quanta and processing power is very valid. Compression 
techniques are preferable in both the imagery and geometry spaces. The lossless nature of 
any compression scheme devised is a probably prerequisite in the market. The incentive 
for image compression is mostly geared towards texture uploads and somewhat less so for 

1 5 display image downloads. A rather conventional project flow anticipates texture validation 
to be fairly dominant at the early stages of a project. Past a certain point in the project life 
span upload weight is shifted towards scene and shader resources and texture traffic is 
significantly reduced. Nevertheless, improving upload efficiency at project early phase is 
important enough (especially to a new service adaptor) to have compression embedded in 

20 the service from its inception. A lossless compression technique, of course, is expected to 
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yield a fairly mild reduction factor. A tiff file format using run-length encoding technique 
is preferable. Run length encoding is especially beneficial for large dynamic range color 
components (16 bits or float). 

Deformed geometry is playing a major role in character animation based movies. 
5 The resultant per-frame scene files are rather big - several tens of MBytes. Despite the use 
of high level primitives (e.g. nurbs, subdivision surfaces), a facial object still uses a fairly 
large number of patches. Known geometry compression schemes are level-of-detail based 
and imply multi-resolution. Multi-resolution techniques may be useful in interactive mode 
and Tenderers like RenderMan already support this convention. Inter-frame geometry 
10 compression techniques as devised by MPEG4 are also preferred. 



APPENDIX A; Sample Authentication Control File 



15 <?xmlversion= ,, 1.0 ,, ?> 

<!-- sample implementation file --> 

<!DOCTYPE AuthenControl 

20 <! ELEMENT PartnerEmail (#PCDATA)> 

<! ELEMENT PartnerPswd (#PCDATA)> 

<!ELEMENT SessionSecured (#PCDATA)> 

<! ELEMENT BatchMode (#PCDATA)> 

<!ELEMENT Application (ApplicationName, ApplicationId)> 
25 <! ELEMENT ApplicationName (#PCDATA)> 

<\ELEMEm Application^ (#PCDATA)> 

]> 



30 



35 



<AutenticationControl> 

<PartnerEmail>l\M<IPartnerEmait> 
<PartnerPswd>. ,.<fPartnerPswd> 
<SessionSecured>M$e<ISessionSecured> 
<BatchMode>Msz<IBatchMode> 
<Application> 

<ApplicationName>Maya</ApplicationName> 
<ApplicationId> 10.1 020345</ApplicationId> 
<l Application 



//or user email address 

// or user password in interactive mode 

// a 'true' tag indicates a fully secured session 

// a 'true' tag indicates batch (pull) mode 

// application name 

// application host ip address 



40 <IAuthenticationControl> 
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APPENDIX B: Sample Session Control File 

A sample of the session control xml file is illustrated. Upload order of resources is implied 
by the appearance in the xml file. Resource path is indicated in the attribute list of the DTD header, 
resource file names are associated with the tags. 



<! ELEMENT SessionControl (Header, Session, Resource, Display)> 
<!ELEMENT Header (Comment, Date, Partnertd, ProjectName)> 
<! ELEMENT Comment (#PCDATA)> 
<! ELEMENT Date (#PCDATA)> 
1 5 <! ELEMENT Partnerld (#PCDATA)> 
<! ELEMENT PartnerPswd (#PCDATA)> 
<! ELEMENT ProjectName (#PCDATA)> 

<\ELEMENT Session (SessionName, Sessionld, SessionPrompt, NumFrames)> 

<! ELEMENT SessionName (#PCDATA)> 
20 <! ELEMENT Sessionld (#PCDATA)> 

<! ELEMENT SessionPrompt (#PCDATA)> 

<! ELEMENT NumFrames (#PCDATA)> 

<!ELEMENT Resource (Scene, Shader, Texture)> 

<! ELEMENT Scene (SceneResource)> 
25 <! ELEMENT SceneResource (#PCDATA)> 

<!ATTLIST SceneResource Path CD ATA #F1XED M D:\believe\sessions\session_motion\scenes"> 

<! ELEMENT Frame (SceneResource)> 

<! ELEMENT Shader (ShaderResource)> 

<! ELEMENT ShaderResource (#PCDATA)> 
30 <!ATTLIST ShaderResource Path CDATA #FIXED n D:\believe\sessions\session_motion\shaders"> 

<!ELEMENT Texture (TextureResource)> 

<! ELEMENT TextureResource (#PCDATA)> 

<!ATTLIST TextureResource Path CDATA #FIXED "D:\believe\sessions\session_motion\textures"> 
<!ELEMENT Procedural (ProceduralResource)> 
3 5 <! ELEMENT ProceduralResource (#PCDATA)> 

<! ATTLIST ProceduralResource Path CDATA #FIXED ll D:\believe\sessions\session_motion\procedurals ,, > 
<! ELEMENT Display (DisplayPath, DisplayPreview)> 
<! ELEMENT DisplayPath (#PCDATA)> 
<! ELEMENT DisplayPreview (#PCDATA)> 



5 



<?xml version^' 1.0 ,, ?> 
<!— session control file --> 



<!DOCTYPE SessionControl 



10 



40 ]> 



<SessionControl> 



<Header> 

4 5 <Comment>BQ\ieve Remote Rendering Service</ Comment> 



II general info about the remote site 



<Date>Thursday, January 11, 200 \<IDate> 
<PartnerId>\lM<iPartnerId> 
<ProjectNamt>. . . <IProjectname> 
<!Header> 



II or user id 

// project name - session parent 



50 



<Session> 

<SessionName>ToyStory3$cme05Shot021<ISessionName> 



II session unique identifier string 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



<SessionId><ISessionId> 
<SessionPriority>2<ISessionPriority> 
<SessionPrompt>ASAP</SessionPrompt> 
<NumFrames> . . .<(NumFrames> 
<ISession> 

<Resource> 
<Scene> 

<SceneResource>. ..<ISceneResource> 

<SceneResource>...<ISceneResource> 
<Frame> 

<ScenResource>. ,.<ISceneResource> 
frame) 

<SceneResource>. ,.<ISceneResource> 
</Frame> 

<Frame> 

<ScenResource>. . . <!SceneResource> 

<SceneResource>, . . <!SceneResource> 

<IFrame> 

</Scene> 

<Shader> 

<ShaderResource> . ,,<!ShaderResource> 

<ShaderResource>. ..<IShaderResource> 
<IShader> 

<Texture> 

<TextureResource> . ..<ITextureResource> 

<TextureResource>. ..</TextureResource> 
<Texture> 

<Procedural> 

<ProceduralResource>. . . <IProceduralResource> 

<ProceduralResource>. . . <IProceduralResource> 

<IProcedural> 

<IResource> 

<Display> 

<DisplayPath>. . .<DisplayPath> 
rendered images 

<DisplayPreview>Mse</DispIayPreview> 
<lDisplay> 



II a valid token indicates resubmit 
// session priority (applicable in batch mode) 
// level of session execution promptness (billing) 
// number of frames in the session 



// static scene description file names 



// dynamic scene description file names (per 



// bounded shader file names 



// bounded texture file names 



// bounded procedural geometry file names 



// location for downloading displayable 
// display preview option 



<ISessionControl> 



55 
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APPENDIX C: Sample Display Control File 

<?xml version="1.0"?> 

<!-- sample implementation file --> 

5 

<!DOCTYPE DisplayControl 

<!ELEMENT DisplayControl (Header, Session, Display)> 
<!ELEMENT Header (Comment, Date, Partnerld, ProjectName)> 
1 0 <! ELEMENT Comment (#PCDATA)> 
<! ELEMENT Date (#PCDATA)> 
<! ELEMENT Partnerld (#PCDATA)> 
<! ELEMENT ProjectName (#PCDATA)> 

<! ELEMENT Session (SessionName, Sessionld, SessionPrompt, NumFrames)> 
1 5 <! ELEMENT SessionName (#PCDATA)> 

<!ELEMENT Sessionld (#PCDATA)> 

<! ELEMENT SessionPrompt (#PCDATA)> 

<! ELEMENT NumFrames (#PCDATA)> 

<\ELEMENT Display (DisplayPath, DisplayPreview, Frame)> 
20 <! ELEMENT DisplayPath (#PCDATA)> 

<IELEMENT DisplayPreview (#PCDATA)> 

<! ELEMENT Frame (Framelndex, RenderTime, ImageType, ImageFormat, ImageRes, ImageDepth)> 
<!ELEMENT Framelndex (#PCDATA)> 
<! ELEMENT RenderTime (#PCDATA)> 
25 <!ELEMENT ImageType (#PCDATA)> 
<! ELEMENT ImageFormat (#PCDATA)> 
<! ELEMENT ImageRes (#PCDATA)> 
<! ELEMENT ImageDepth (#PCDATA)> 

]> 

30 

<DisplayControl> 
<Header> 

<Comment>Be\ieve Remote Rendering Serviced 'Comment> 
3 5 <Z>ate>Thursday, January 1 1 ,200 1 </Date> 
<PartnerId>lLM</PartnerId> 
<ProjectNamo>. . . </Projectname> 
</Header> 

40 <Session> 

<SessionName>ToyStory3ScQnc05Shot027</SessionName> 

<SessionId>ILM012345</SessionId> 
<SessionPrompt>ASAP</SessionPrompt> 
<NumFrames>. . . </NumFrames> 
45 </Session> 

<Display> 

<DisplayPath>. . .</DisplayPdtf/i> 
images 

50 <DispiayPreview>f&lse</DisplayPreview> 

<Frame> 
resolution 

<FrameIndex>. ..<IFrameIndex> 
55 <RenderTime>. . .</ Render Time> 



ii general info about the remote site 



// or user id 

// project name - session parent 



// session unique identifier string 
// session id registered on Believe' s site 
// level of session execution promptness 
// total number of frames rendered 



// remote location of downloaded displayable 
// display preview option 
// frame data: render time, type, format, 



// in hours 
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<lmageType>. . .</ImageType> 
<lmageFormat> . . . <IImageFormat> 
<lmageRes>. . . <IImageRes> 
<lmageDepth>fo[se<ImageDepth> 



// marks the presence of a depth image file 



5 <!Frame> 
<Frame> 

<FrameIndex>. . .</FrameIndex> 
<RenderTime> . . . <I Render Time> 

1 0 <ImageType> . . . <HmageType> 

<ImageFormaf> . . .<HmageFormat> 
<ImageRes>. . . <JImageRes> 
<ImageDepth>truo<ImageDepth> 
<IFrame> 

15 <IDisplay> 



<!DisplayControl> 



20 APPENDIX D: Sample Shader Generation Control File 

<?xml version="l.(r?> 

<!-- sample implementation file «> 

25 <!DOCTYPE ShaderControl 
[ 

<!ELEMENT ShaderControl (Shader)> 
<! ELEMENT Shader (ResourceSources, ShaderMake)> 
<! ELEMENT ResourceSources (ShaderSource)> 
30 <! ELEMENT ShaderSource (#PCDATA)> 
<!ELEMENT ShaderMake (#PCDATA)> 
]> 

<ShaderControl> 



35 



<Shader> 

<ResourceSources> 
<ShaderSource>. ..<IShaderSource> 



If shader source file name (.si, .h, .c, .cpp) 



40 <ShaderSource> . . . </ShaderSource> 
<i ResourceSources 



<ShaderMake>. . .<! Shader Mak&> 
</Shader> 



II shader make file (.mak) 



45 



<Shader> 



<!Shader> 



50 <IShaderControl> 
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APPENDIX E: Sample Texture Generation Control File 

<?xml version=" 1 .0"?> 

<!-- sample implementation file --> 

5 

<!DOCTYPE TextureControl 
[ 

<! ELEMENT TextureControl (Texture)> 

<! ELEMENT Texture (Input, Output, Mode, Filter)> 
1 0 <! ELEMENT TextureType (#PCDATA)> 

<! ELEMENT TextureSubType (#PCDATA)> 

<! ELEMENT Input (LnageFile)> 

<! ELEMENT ImageFile (#PCDATA)> 

<! ELEMENT Output (TextureFile, NumBytes, Float)> 
1 5 <! ELEMENT TextureFile (#PCDATA)> 

<! ELEMENT NumBytes (#PCDATA)> 

<! ELEMENT Float (#PCDATA)> 

<! ELEMENT Mode (SWrap, TWrap, RWrap)> 

<! ELEMENT SWrap (#PCDATA)> 
20 <! ELEMENT TWrap (#PCDATA)> 

< ! ELEMENT R Wrap (#PCDATA)> 

<!ELEMENT Filter (Func, SWidth, TWidth, RWidth)> 

<! ELEMENT Func (#PCDATA)> 

<!ELEMENT SWidth (#PCDATA)> 
25 <! ELEMENT TWidth (#PCDATA)> 

< ! ELEMENT R Width (#PCDATA)> 

<! ELEMENT TextureDepth (#PCDATA)> 

< ! ELEMENT FieldOJView (#PCDATA)> 

30 ]> 

<TextureControl> 



<Texture> 

<TextureType> . . . <ITextureType> 
35 <TextureSubType>. ..</TextureSubType> 

<Inpuf> 

<ImageFile> . . ,<HmageFile> 

40 <ImageFile> . . . <IImageFile> 
<flnput> 



H one of 2D, 3D, environment, bump, shadow 
// one of cube, longlat (for environment map) 

// input image file name(s) 



<Output> 

<TextureFile>. . . </TextureFile> 
45 <NumBytes> . . . <INumBytes> 
<Float>...<iFloaf> 
</Output> 



II output texture file name 

// number of bytes per component (1, 2 or 4) 

// takes true or false, used for either 2 or 4 bytes 



<Mode> 
50 <SWrap>...<lSWrap> 
<TWrap>. . . <ITWrap> 
<R Wrap> ...</R Wrap> 
<IMode> 



II one of black, clamp, periodic 



55 <Filter> 

<Func> . . . </Func> 



11 one of box, triangle, catmull-rom, b-spline, gaussian, sine 
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<SWidth>...<lSWidth> 
<TWidth>. . . <ITWidth> 
<RWidth>...<!RWidth> 
<IFilter> 

5 

<TextureDepth>. . . <ITextureDepth> II texture depth for 3D textures 

<FieldOfView> . . . <IFieldOJView> II field-of-view for cubic environment map 

<ITexture> 

10 

<Texture> 
<ITexture> 
1 5 <ITextureControl> 

APPENDIX F: Sample Procedural Generation Control File 

20 <?xml version=" 1 .0 H ?> 

<!— sample implementation file — > 

<!DOCTYPE ProceduralControl 

25 <!ELEMENT ProceduralControl (Procedural)> 

<! ELEMENT Procedural (ResourceSources, ProceduralMake)> 

<! ELEMENT ResourceSources (ProceduralSource)> 

<! ELEMENT ProceduralSource (#PCDATA)> 

<!ELEMENT ProceduralMake (#PCDATA)> 
30 ]> 

<ProceduralControl> 

<Procedural> 
35 <ResourceSources> 

<ProceduralSource> . . . <IProceduralSource> II procedural source file name (.h, .c, .cpp) 

<ProceduralSource>, . . <IProceduralSource> 
<l ResourceSources 

40 

<ProceduraIMake>. . . <IProceduralMake> II procedural make file (.mak) 

<IProcedurat> 

<Procedural> 

45 ... 

<IProcedural> 
</ProceduralControl> 

50 

APPENDIX G: Rendering Request Dispatch API Description 



This section describes the api for dispatching rendering requests from the rrp server 
to the scene server. Also, included in this discussion is the scooping of rendering status 
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format, deposited by the scene server into a session node folder. The api is termed the 
Render Request Interface (or rri for short). The interface is layered on top of a networking 
library. 

In general, both the rrp and the scene server can potentially be realized by using 
5 multiple physical host platforms for the sake of scalability. To this extend a load balancer 
would potentially mediate rendering requests to multiple scene servers. The rrp server 
keeps track of the submitted rendering queue depth for each scene server it communicates 
with. Additional rendering requests are dispatched only once the scene server submitted 
queue is not ML 

10 The list of rri api entry points, as viewed from the rrp server stand point, and a brief 

description follows: 

- Network start/stop: 

o initialize^}: initialize communication with scene server whenever restarting the rrp 
15 server. 

o shutdown(): shutdown communication with the scene server, whenever the rrp 
server is stopped. 

- Connection scope: 

20 o frameStart(String serverName): opens a connection to the scene server, 
o frameEnd(): closes the opened connection with the scene server. 

- Render request: 

o sessionNode(String path): provides the session node path to the scene server as a 
25 key/value string pair e.g. "SessionPath=<path>". 

o renderFrame(String scene): rendering request providing a stream to the scene server 
, holding the scene description e.g. "Scene=\n" followed by the scene description. 

The scene server is expected to deposit periodically status for each frame in rendering 
30 progress. The status is recorded in an xml file in the status session node folder e.g. the 
scene server appends /status to the session path provided in the session node entry point. 
The naming convention for a frame status file is: frame jstatus_<frame_index>. xml. Note 
that the frame index is the physical frame number represented in four decimal digits e.g. 
frame_status_0001 .txt. 
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The format of the status xml file is depicted: 



<?xmlversion="1.0 f, ?> 
<!-- sample implementation file --> 

5 

<!DOCTYPE StatusControl 
[ 

<!ELEMENT StatusControl (Framelndex, Status)> 

<!ELEMENT Framelndex (#PCDATA)> 
1 0 <!ELEMENT Status (TimeOfDay, Progress, Error, Duration, Complexity)> 

<! ELEMENT TimeOfDay (#PCDATA)> 

< ! ELEMENTProgress (#PCDATA)> 

<! ELEMENT Error (#PCDATA)> 

<\ELEMENTDuration (#PCDATA)> 
15 <mLEMENTComplexity (#PCDATA)> 

]> 

<StatusControl> 
20 <FrameIndex> . . . <IFrameIndex> 
<Status> 

<TimeOJDay>200\-04-26 23:Q5:34</TimeOfDay> 
<Progress>.5</Progress> 
25 <Error>Success(Q)</Error> 
<Duration>23 . 6</Duration> 
<Complexity>6</ Complexity> 
<lStatus> 

30 <IStatusControl> 

Final rendered images per frame are deposited into the display folder of the session 
node e.g. the scenes server appends /display to the session path provided in the session 
node entry point. 

35 

APPENDIX H: Sample Batch Control File 



<?xml version^' 1.0"?> 
<!-- sample implementation file --> 

40 

<!DOCTYPE BatchControl 

<! ELEMENT BatchControl (Header, Session)> 
<! ELEMENT Header (Comment, TimeOfDay, Partnerld)> 
45 <! ELEMENT Comment (#PCDATA)> 
<! ELEMENT TimeOfDay (#PCDATA)> 
<!ELEMENTPartnerId (#PCDATA)> 

<! ELEMENT Session (SessionName, SessionPriority, SessionPrompt)> 
<! ELEMENT SessionName (#PCDATA)> 
50 <! ELEMENT SessionPriority (#PCDATA)> 



# time of day in iso format yyyy-MM-dd hh:mm:ss 

# a float value in the range of .Of to l.f 

# one of Success or Failure, error code in parenthesis 

# a float value of rendering duration in minutes 

# frame complexity in the scale of 1 to 10 
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<! ELEMENT SessionPrompt (#PCDATA)> 
]> 

<BatchControl> 

5 

<Header> 

<Comment>Believe Remote Rendering Service</Comment> 

<TimeOfDay>Monday,May 21 J 2001</TimeO£Day> # time of day in iso format yyyy-MM-dd hh:mm:ss 
<PartnerId>Sony</PartnerId> 
10 </Header> 

<Session> 

<SessionName>Movie_Scene_ShotO</SessionName> # session unique identifier string 
<SessionPriority>2</SessionPriority> # session priority 

1 5 <SessionPrompt>AS AP</SessionPrompt> # session execution promptness (billing) 

</Session> 

<Session> 
20 </Session> 

</BatchControl> 



Whereas many alterations and modifications of the present invention will no doubt 
25 become apparent to a person of ordinary skill in the art after having read the foregoing 
description, it is to be understood that the particular embodiments shown and described by 
way of illustration are in no way intended to be considered limiting. For example, while 
the preferred embodiments supra are described in terms of a rendering process that 
converts three-dimensional modeling data into two-dimensional images, the output of the 
30 rendering process might also be three-dimensional renderings (e.g., holograms) without 
departing from the scope of the preferred embodiments. Therefore, reference to the details 
of the preferred embodiments are not intended to limit their scope, which is limited only by 
the scope of the claims set forth below. 
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